This our own evaluation of individual forecasts submitted to the EpiExpert model. This model is submitted to the German and Polish Forecast Hub each week.
These evaluations are preliminary - this means we cannot rule out any mistakes and the plots and analyses are subject to change. The evaluations are also not authorised by the German Forecast Hub team.
If you have questions or want to give feedback, please create an issue on our github repository.
model compare_against ratio pval adj_pval theta_i theta_j
1: EpiNow2 sophiemeakin NA NA NA 1 1 2: EpiNow2 Joel NA NA NA 1 1 3: EpiNow2 seb NA NA NA 1 1 4: EpiNow2 nib NA NA NA 1 1 5: EpiNow2 seabbs NA NA NA 1 1 —
221: anonymous_Cat anonymous_Cat 1 1 1 1 1 222: Sqxleaxes Sqxleaxes 1 1 1 1 1 223: hababylon hababylon 1 1 1 1 1 224: anonymous_Okapi anonymous_Okapi 1 1 1 1 1 225: anonymous_Shrew anonymous_Shrew 1 1 1 1 1
Only those forecasters are named who have submitted a forecast in the most recent evaluated week.
Overview of all the models and metrics
Overview of all models and metrics stratified by forecast horizons
Weighted interval score broken down into its components “overprediction penalty”, “underprediction penalty” and “sharpness”
Plot of the percentage of true values captured by each prediction interval
Plot of the percentage of true values below each predictive quantile level